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INgfHE UNITED STATES PATENT AND TRADEMARK OFFICE 

SfSppSCation Serial No 08/902,005 

Filing Date 7/29/1997 

Inventorship ..:.:/.. Butler et al. 

Group Art Unit : 2711 

Examiner Tran, H. 

Applicant Microsoft Corporation 

Attorney's Docket No MS 1 - 1 1 9US 

Title: Providing Enhanced Content With Broadcast Video . 

TRANSMITTAL LETTER AND CERTIFICATE OF MAILING 



To : The Commissioner of Patents & Trademarks 

Washington, D.C. 20231 



88| 



Flom: tt%£w"™^*** m * m> TechnoiooyCentertgoo 

421 W. Riverside Avenue, Suite 500 
Spokane, WA 99201 

The following enumerated items accompany this transmittal letter and are being submitted for the 
matter identified in the above caption. 

1 . Transmittal letter including Certificate of Mailing 

2. Response to Office Action dated December 19, 2000 

3. Return Post Card 

Large Entity Status [x] Small Entity Status [ ] 

Applicant hereby requests an extension of time in any case such an extension is necessary. The fee 
should be charged to the Deposit Account indicated below. 

The Commissioner is hereby authorized to charge payment of fees or credit overpayments to Deposit 
Account No. 12-0769 tfi connection with any patent application filing fees under 37 CFR 1.16, and any 
processing fees, including any necessary extension fees under 37 CFR 1.17. 





anceX. S J 
Reg. No. 38,605 



CERTIFICATE OF MAILING 

I hereby certify that the items listed above as enclosed are being deposited with the U.S. Postal 
Service as first class mail in an envelope addressed to The Commissioner of Patents & Trademarks, 
Washington, D.C. 20231, on the below- indicated date 
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IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 

pplication Serial No 08/902,005 

filing Date 7/29/97 

Inventorship Butler et al. 

Applicant Microsoft Corporation 

Group Art Unit 2711 

Examiner Tran, H. 

Attorney's Docket No MS 1-1 19US 

Title: Providing Enhanced Content With Broadcast Video 

RESPONSE TO OFFICE ACTION DATED DECEMBER 19, 2000 

To: Commissioner of Patents and Trademarks 

Washington, D.C. 2023 1 BECEf Vi© 

MAR 2 a 

From: Lance R. Sadler (Tel. 509-324-9256; Fax 509-323-8979) 

Lee & Hayes, PLLC technology Center 

421 W. Riverside Avenue, Suite 500 
Spokane, WA 99201 



REMARKS 

Claims 1-50 remain in the application for consideration. In view of the 
following remarks, Applicant respectfully requests reconsideration and withdrawal 
of the present rejections. 

Section §103 Rejections 

Claims 1-6, 11-15, and 40-43 stand rejected under 35 U.S.C. §103(a) over 
U.S. Patent No. 5,818,441 to Throckmorton et al. (hereafter "Throckmorton"), in 
view of U.S. Patent No. 6,058,430 to Kaplan (hereinafter "Kaplan"). Claims 7-10, 
16-39 and 44-50 stand rejected under §103 over Throckmorton in view of Kaplan 
and U.S. Patent No. 5,621,428 to King (hereinafter "King"). 
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For the reasons set forth below, the Office's §103 rejections are improper 
and must be withdrawn. 

The Standard for §103 Rejections 

In making out a §103 rejection, there must be evidence of a suggestion, 
teaching, or motivation to combine the references. In re Dembiczak, 50 USPQ2d 
1614, 1617. Combining the prior art references without evidence of such as 
suggestion, teaching, or motivation simply takes the inventor's disclosure as a 
blueprint for piecing together the prior art to defeat patentability — the essence of 
hindsight. Id. The evidence may flow from the prior art references themselves, 
the knowledge of one of ordinary skill in the art, or, in some cases, from the nature 
of the problem to be solved. Id. The showing, however, must be clear and 
particular. Id. Broad conclusory statements regarding the teaching of multiple 
references, standing alone, are not "evidence." Id. 

Discussion of the References 

As a preliminary matter, in making out the §103 rejections, the Office notes 
that Throckmorton does not specifically disclose or teach supplemental data files 
having instructions for rendering a hyperlink overlay on the video stream. 
Applicant agrees. In point of fact, Throckmorton teaches directly away from any 
such notion be specifically teaching that "associated data" (i.e. analogous in some 
respects to Applicant's recited supplemental data) can be received with the 
primary data (i.e. the live or pre-recorded program information) and stored in 
memory for "future use". See, e.g. column 4, lines 25-28. Accordingly, not only 
does Throckmorton not teach, hint, or suggest that any such associated data is ever 
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displayed on or overlaid with the primary data for user viewing, it teaches directly 
away from this notion. 

In making out the §103 rejections, the Office relies on Kaplan (citing to 
Kaplan's column 5, lines 1-6), and argues that Kaplan teaches "including 
instructions for rendering a hyperlink overlay on the video stream." See, e.g. 
Office Action dated 12/19/00, page 3, first paragraph. 

Applicant respectfully disagrees and submits that the Office has 
misinterpreted Kaplan. Specifically, Kaplan discloses a system that transmits a 
program, for example a television program, and encodes and transmits an Internet 
address associated with the program in the Vertical Blanking Interval. See, 
column 2, lines 1-7; column 4, lines 35-41. The Internet addresses that are 
transmitted relate to the program, content of the program, or commercial broadcast 
on the incoming signal. See, column 2, lines 59-61. A processor 22 (see, e.g., 
Kaplan's Fig. 1) decodes the URL Internet address and transmits the URL to 
another processor in an Internet subsystem 12 which checks to see whether the 
URL is a valid address. If the address is a valid address, Kaplan's system simply 
signals that a valid address has been received. Specifically, Kaplan sets forth in 
column 5, lines 1-13: 



If it [i.e. the URL] is [a valid address], the processor 
(40) instructs the graphic display controller (46) to signal that 
a valid URL Internet address had been received. The graphic 
display controller (46) is also interfaced with the video 
amplifier such that its graphics can be overlaid on the video 
image projected to the picture tube. The graphic display 
controller (46) can place an information symbol , icon or text 
message on the screen indicating that the processor (40) has 
received an Internet address. In another embodiment of the 
present invention, external lights such as light emitting diodes 
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(LED's) can be used to signal the user that a valid URL has 
been received . These LED's most typically will be 
incorporated into the housing of the television. 

Kaplan's system is essentially just a signaling system that signals a user 
that a valid URL has been received. It does this by using an information symbol, 
icon, or text message on the television screen. These graphics are presumably 
rendered in the same way that closed caption graphics are rendered. See, e.g. 
Kaplan, column 4, lines 53-61, which states, "[t]he OSD processor (22) is also 
connected to the tuner (20) such that it can receive the VBI portion of the 
incoming RF signal (50). The OSD processor (22) decodes the information 
embedded in the VBI. In all modern televisions, this includes the closed 
captioning information in scan line 21 . In the present invention, the OSD 
processor (22) will also decode embedded URL Internet addresses and related 
information embedded in one or more of the scan lines 10 through 20." This is not 
a hyperlink overlay as completed in Applicant's claims and described in 
Applicant's specification. Rather, Kaplan simply renders a symbol of some sort 
on the screen to indicate that a valid URL has been received. 

Nowhere does Kaplan disclose or suggest including instructions for 
rendering a hyperlink overlay on a video stream. Accordingly, the Office has 
misinterpreted Kaplan and ascribed to it properties that it simply does not have. 

Thus, the following can be said of Throckmorton and Kaplan: 

1. Throckmorton does not teach, hint, or suggest that any such 
associated data is ever displayed on or overlaid with the primary data 
for user viewing. In fact it teaches directly away from this notion as 
pointed out above; 

2. Kaplan does not disclose or suggest including instructions for 
rendering a hyperlink overlay on a video stream. 
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There simply is no clear and particular teaching in any of these references, 
as there must be, that would lead one of ordinary skill in the art to combine the 
references to render the subject matter of the claims discussed below obvious. 

Discussion of the Claims 

Claim 1 recites a method directed to transmitting supplemental data files 
along with a video stream. The supplemental data files are formatted "in a 
graphical markup language", each having instructions for "rendering a hyperlink 
overlay on the video stream." 

None of the references cited by the Office disclose or suggest the subject 
matter of claim 1. Accordingly, claim 1 is allowable. 

Claims 2-15 depend either directly or indirectly from claim 1, and are 
allowable as depending from an allowable base claim. These claims are also 
allowable for their own recited features which, in combination with those recited 
in claim 1, are neither shown nor suggested by the references of record. 

Claim 16 recites a method for rendering hyperlink pages on a video stream 
and specifically recites "formatting HTML files having instructions for rendering 
hyperlink pages on a video stream ." None of the references cited by the Office, as 
pointed out above, disclose or suggest this feature. Accordingly, this claim is 
allowable. 

Claims 17-23 depend from claim 16 and are allowable as depending from 
an allowable base claim. These claims are also allowable for their own recited 
features which, in combination with those recited in claim 16, are neither shown 
nor suggested by any of the references of record, either singly or in combination 
with one another. 
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Claim 24 recites a method in which a video stream is received. One or 
more hyperlink pages are associated with the video stream and have transparent 
areas that are set to a key color. The hyperlink pages are displayed on a display. 
The video stream is displayed on the display in areas of displayed hyperlink pages 
that are set to a key color. Thus, this method recites displaying a video stream 
within areas of a hyperlink page. Nowhere do any of the references cited by the 
Office disclose or suggest any such method. Accordingly, claim 24 is allowable. 

Claims 25-31 depend from claim 24 and are allowable as depending from 
an allowable base claim. These claims are also allowable for their own recited 
features which, in combination with those recited in claim 24, are neither shown 
nor suggested by the references of record, either singly or in combination with one 
another. 

Claim 32 is directed to a computer-readable storage medium having 
instructions for performing steps that are the same as those set forth in claim 24. 
For all of the reasons set forth above with respect to the patentability of claim 24, 
this claim is allowable. 

Claims 33-39 depend from claim 32 and are allowable as depending from 
an allowable base claim. These claims are also allowable for their own recited 
features which, in combination with those recited in claim 32, are neither shown 
nor suggested by the references of record, either singly or in combination with one 
another. 

Claims 40-43 recite a video broadcast system. Claim 40 specifically 
recites "a broadcast source that broadcasts a video stream and provides 
accompanying supplemental data files, each supplemental data file having 
instructions for rendering a hyperlink overlay on the video stream ; [and] a 
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receiver configured to receive the video stream and accompanying supplemental 
data files and to display the hyperlink overlays in conjunction with the video 
stream." Nowhere do any of the references cited by the Office disclose or suggest 
a broadcast system in which a broadcast source provides a video stream and 
accompanying supplemental, data files each of which have instructions for 
rendering a hyperlink overlay "on" the video stream. Rather, as pointed out 
above, the references fall far short of teaching or suggesting the claimed subject 
matter. Accordingly, claim 40 is allowable. 

Claims 41-44 depend from claim 40 and are allowable as depending from 
an allowable base claim. These claims are also allowable for their own recited 
features which, in combination with those recited in claim 40, are neither shown 
nor suggested by the references of record. Accordingly, these claims are 
allowable. 

Claim 45 recites a receiver for receiving and displaying video streams. The 
claim recites display hardware for displaying video streams and bit-mapped 
images to a user. The display hardware is recited to include color keying 
hardware that displays video in display areas that are set to a key color. Access 
means are recited for reading supplemental data files that have instructions for 
rendering bit-mapped hyperlink overlays in conjunction with the video stream at 
indicated times. A data processor is recited to read the supplemental data files and 
in response display the hyperlink overlays at the indicated times. The hyperlink 
overlays have transparent areas that are set to a key color thus appearing to overlay 
the video streams . As pointed out above, none of the references cited by the 
Office disclose or suggest any such system in which any hyperlink overlays appear 
to overlay a video stream. Accordingly, this claim is allowable. 
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Claims 46-50 depend from claim 45 and are allowable as depending from 
an allowable base claim. These claims are also allowable for their own recited 
features which, in combination with those recited in claim 45, are neither shown 
nor suggested by the references of record, either singly or in combination with one 
another. 

Conclusion 

Applicant submits that all of the claims are in condition for allowance and 
respectfully requests a Notice of Allowability be issued forthwith. If the Office's 
next anticipated action is to be anything other than issuance of a Notice of 
Allowability, Applicant respectfully request that the undersigned be contacted for 
the purpose of scheduling an interview. 



Respectfully Submitted, 




L^nce R. Sadler 
Reg. No. 38,605 
(509) 324-9256 
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